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Abstract. Experts take into account several criteria to assess the effec- 
tiveness of torrential flood protection systems. In practice, scoring each 
criterion is imperfect. Each system is assessed choosing a qualitative class 
of effectiveness among several such classes (high, medium, low, no). Evi- 
dential Reasoning for Multi-Criteria Decision-Analysis (ER-MCDA) ap- 
proach can help formalize this Multi-Criteria Decision-Making (MCDM) 
problem but only provides a coarse ranking of all systems. The recent 
Belief Function-based Technique for Order Preference by Similarity to 
Ideal Solution (BF-TOPSIS) methods give a finer ranking but are lim- 
ited to perfect scoring of criteria. Our objective is to provide a coarse 
and a finer ranking of systems according to their effectiveness given the 
imperfect scoring of criteria. Therefore we propose to couple the two 
methods using an intermediary decision and a quantification transfor- 
mation step. Given an actual MCDM problem, we apply the ER-MCDA 
and its coupling with BF-TOPSIS, showing that the final fine ranking is 
consistent with a previous coarse ranking in this case. 


Keywords: Belief Functions, BF-TOPSIS,ER-MCDA, Torrent protec- 
tion. 


1 Introduction 


In mountainous areas, torrents put people and buildings at risk. Thousands of 
check dams, clustered in series, have been built to protect them. Risk managers 
must assess their effectiveness given several criteria such as their structural sta- 
bility or their hydraulic dimensions. This is a Multi-Criteria Decision-Making 
(MCDM) problem. In practice, scoring each criterion is difficult and imperfect. 
Experts affect each check dam series to one of several qualitative evaluation 
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classes of effectiveness (high, medium, low, no) [1]. Evidential Reasoning for 
Multi Criteria Decision Analysis (ER-MCDA) has been developed on the ba- 
sis of fuzzy sets, possibility and belief function theories [2,3] to decide on such 
MCDM problems, taking into account imperfect assessment of criteria provided 
by several sources. 

Given the final qualitative label for each check dam series, a coarse ranking 
of all of them can be provided, as shown in recent applications [1]. Nevertheless, 
risk managers need a finer ranking to choose the most effective one. To help it, 
the recent Belief Function-based Technique for Order Preference by Similarity 
to Ideal Solution (BF-TOPSIS) methods [4] are more robust to rank reversal 
problems than other classical decision-aid methods such as the Analytic Hier- 
archy Process (AHP) [5]. Nevertheless, the BF-TOPSIS methods are limited to 
MCDM problems with precise quantitative evaluation of criteria. 

To help risk managers rank several check dam series according to their ef- 
fectiveness, the BF-TOPSIS should take into account the initial imperfect as- 
sessment of criteria. Therefore, we propose to combine the ER-MCDA and BF- 
TOPSIS methods. We first detail the ER-MCDA process and apply it to an 
actual case with a final coarse ranking. We then combine ER-MCDA with BF- 
TOPSIS. Applying it to the same example, we finally show that the finer ranking 
result obtained is consistent with the previous coarse ranking result in this case. 


2 Some basics of belief function theory 


Shafer proposed belief function theory [6] to represent imperfect knowledge (im- 
precision, epistemic uncertainty, incompleteness, conflict) through a basic belief 
assignment (BBA), or belief mass m(-), given the frame of discernment (FoD) 
O. All elements 6,,k = 1,...,q of O are considered exhaustive and mutually 
exclusive. The powerset 2° is the set of all subsets (focal elements) of O, the 
empty set included. Each body (or source) of evidence is characterized by a 
mapping m(-) : 2? > [0, 1] with m(0) = 0, and £ yco M(X) = 1,YX # p € 2°. 
For a categorical BBA denoted mx, it holds that mx(X) = 1 and mx(Y) =0 
ifY COAX. 

Given O, numerous more or less effective rules allow combining several BBAs. 
Before their combination, each BBA m(-) can be differently discounted by the 
source reliability or importance [7]. The comparison of the combination rules 
is not the main scope of this paper, and hereafter we use the 6th Proportional 
Conflict Redistribution (PCR6) fusion rule, developed within the framework of 
Dezert-Smarandache Theory (DSmT) [8] (Vol. 3). The latter is a modification 
of belief function theory, designed to palliate the disadvantages of the classical 
Dempster fusion rule [9]. 

Given m(-), choosing a singleton 6 € O or subset X C @ is the decision issue. 
In general, it consists in choosing 6 = Oy, k =1,...,q with k* ê arg max,C (0p), 
where C(x) is a decision-making criterion. Among several C(;), the most 
widely used one is the belief Bel(O,) & m(0%) corresponding to a pessimistic 
attitude of the Decision-Maker (DM). On the contrary, the plausibility Pl(0,) = 
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> xne,40|xe2e M(X) is used for an optimistic attitude. Between those two ex- 
treme attitudes, an attitude of compromise is represented by the decision based 
on the maximum probability. For this, the BBA m(-) is transformed into a sub- 
jective probability measure P(-) through a probabilistic transformation such as 
the pignistic one [10], the normalized plausibility transformation [11], etc. 

In some cases, taking into account non-singletons X C O is needed to make a 
decision. As shown in [12], the minimum of any strict distance metric d(m, mx) 
between m(-) and the categorical BBA mx can be used in Eq. (1). If only 
singletons of 2° are accepted, the decision is defined by Eq. (2). 


£ arg minx €26\19}d(m, mx) (1) 


6 * 0p» Ê argmin,_, 2) 


ie ( 
Among the few true distance metrics! between two BBAs mj4(-) and ma(-), 
the Belief Interval-based Euclidean dgr(mi, mz) € [0,1] defined by Eq. (3) [13] 
provides reasonable results. It is based on the Wasserstein distance defined by 
Eq. (4) [14] with [a1, b1] = B(X) £ [Bel (X), Ply(X)] and faz, bo] = BR(X) £ 
[Belg(X), Pla(X)] for X € ©. 
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_ The quality indicator q(X) defined by Eq. (5) evaluates how good the decision 
X is with respect to other focal elements: the higher q(X) is, the more confident 
in its decision X the DM should be. If only singletons of 2° are accepted, g(X) = 


q({6}) is defined by Eq. (6). 


r dzar(m,mg) 
q(X) 41 
De xe2°\{0} dgr(m,mx) 








(5) 


dar(m, m6) 


Di1 dar (m, m46,}) 





q({O}) 1 





' For any BBAs z, y, z defined on 2°, a true distance metric d(x,y) satisfies the 
properties of non-negativity (d(x,y) > 0), non-degeneracy (d(x,y) = 0 & x = y), 
symmetry (d(x,y) = d(y,x)), and triangle inequality (d(x, y) + d(y, z) > d(x, z)). 
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3 From ER-MCDA to decision-making 


3.1 Multi-Criteria Decision-Making problems 


Ina MCDM problem, the DM compares alternatives A; € A £ {.Aj, Ao,..., An} 
through N criteria Cj, scored with different scales. Each C; has an importance 
weight wj € [0,1] assuming aa wj = 1. The N-vector w = [w1,..., wy] rep- 
resents the DM preferences between criteria. The AHP process helps extract it, 
comparing criteria pairwisely [5]. The DM gives an M x N score matrix S = [S;;] 
in Eq. (7). S;j is a score value of A; according to the scoring scale of the criterion 
Cj. In practice, S;j for each alternative A; is given in hazardous situations, with 
no sensor and in a limited amount of time. The sources of information can there- 
fore be imprecise, epistemically uncertain, incomplete and possibly conflicting. 


Given the matrix S, 


Sui... SMj ... SMN 


we consider two different decision-making assessments (DMA1 and DMA2). 
Given a final FoD © = {6;,...,,}, DMA1 involves choosing a singleton 6(A;) € 
O for each alternative A;, i = 1,..., M. Given S, DMA2 consists in totally rank- 
ing the M alternatives A; and choosing the best one Ai». 


3.2 The ER-MCDA for the DMA1 given imperfect Sij 


e Step laa (M® construction): Given the FoD O = {64,... , 0q} of qualitative 
labels, the set A of M alternatives, the N criteria Cj and wj, the M x N 
BBA matrix M® = [m3 (-)] is provided in Eq. (8). For each criterion Cj, a 
possibility distribution 7,; [15] is provided by an expert through intervals Fy,, 
t=1,...,¢max With a confidence level. This represents the imprecise scoring of 
Sij of each alternative A;. The mapping [2] of each possibility distribution into 
q fuzzy sets 0,, k = 1,...,q [16] provides each BBA m$(-) on 2° for each Aj, 


i=1,...,M and Cj, j =1,...,N in the BBA matrix M®. 


mh (-) ee mC) ee mn (-) 
M® £ | m8) ... mB)... M&C) (8) 
2 
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The algorithm of the geometric mapping process is detailed in [2]. A BBA 
mig! (-) is first extracted from each m;j: the FoD is the scoring scale X; of the 
criterion Cj; focal elements are the intervals Fy,, t = 1,...,¢max. Then each 
interval Fa, is mapped into each fuzzy set 6, to obtain its geometric area A, k, 
with A, £ Xj.. A final BBA is then computed for the FoD © with 


max pps Aik 
me (9x) = De: mij (Fa) a 





e Step 2.14 (DMA1): We refer the reader to [3] for details. Each BBA m&(-) is 
discounted by the importance weight w; of each criterion C4. For each A; € A, 
the N BBAs m$ (+) are combined? with importance discounting [3] to obtain the 
BBA m9(-) for each i*”-row. Given that the FoD O = {6),...,0%,...,0q} and 
for each A;, 6(A;) = argming_1 gdar(m?, myo, }) is chosen, where m,9,} is 
the categorical BBA focused on the singleton {0x} only, based on the minimum 
of dgr defined by Eq. (3). 

Given a preference ranking of the q elements of O, comparing all the 6(A;) 
chosen for each A; helps rank the A; alternatives. Nevertheless, it is not neces- 
sarily a strict ranking since the label 6(A;) may be the same for several Aj. 


3.3 BF-TOPSIS methods for the DMA2 given precise Sij 


Four BF-TOPSIS methods were developed to decide on the corresponding M x N 
matrix S = [S;;] (Eq. (7)), with the precise score value S;;. Details are given in 


All BF-TOPSIS methods start with the same construction of the M x N 
matrix M4 = [ms (-)] from S for the FoD A= {Aj, Ao,..., Am }. In the sequel, 
A; denotes the complement of A; in the FoD A. For each A; and each Cj, 
the positive support Sup;(A;) * Skei, MySp <i; [Sij — Sky] measures how 
much A; is better than other alternatives according to criterion C;. The negative 
Sij — Skj| measures how much A; is 








press 


worse than other alternatives according to Cj. Given Alax = max; Sup;(A;) 


and A? Ê min; Inf j(Ai), each mi (+) is consistently defined by the triplet 


(mA (As), mi(Ai), må (A; U A;)) presented on the FoD A by: 


Sup; (Ai) if Aj 0 
mA) E 4 Abe | o max 7 (9) 
0 if Ahax = 0 
PEAY IfA mO 
mO: 4 Amin NP á (10) 
0 if A in = 0 
mÅ(A: U Ai) & m4 (O) £ 1 — (Belĝ (Ai) + Bel4 (Ai) (11) 


? with the PCR6 rule in this paper [8] (Vol. 3). 
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To help rank all alternatives A; € A, the main idea of BF-TOPSIS methods is 
to compare each A; with the best and worst ideal solutions. It is directly inspired 
by the technique for order preference by similarity to the ideal solution (TOPSIS) 
developed in [17]. The four BF-TOPSIS methods differ from each other in how 
they process the Mx N matrix M^ with an increasing complexity and robustness 
to rank reversal problems. In this paper, we focus on BF-TOPSIS3 (the 3rd BF- 
TOPSIS method using the PCR6 fusion rule) [4]. 


1. For each A;, the N BBAs mi (+) are combined? to give m#(-) on 24, taking 
into account the importance factor wj of each criterion C; [7]. 

2. For each A; € A, the best ideal BBA defined by m#?°*(A;) ê 1 and 
the worst ideal BBA defined by m#¥°"*'(A;) £ 1 means that A; is better, 
and worse, respectively, than all other alternatives in A. Using Eq. (3), one 
computes the Belief Interval distance d>°*(A;) = dgr(m#, m/st between 
the computed BBA mź(-) and the ideal best BBA m7+>**(.). Similarly, one 
computes the distance dY°"t( A;) = dgr(mA,mA"""*) between mA(-) and 
the ideal worst BBA m£¥9"t(.), 

3. The relative closeness of each alternative A; with respect to an unreal ideal 
best solution defined by AP®t is given by C(A;, A>) £ grow er aay 
Since d¥°'s*(A;) > 0 and d>e*(A;) > 0, then C(A;, A**) € [0, 1]. 

If dest(A;) = 0, then C(A;, AP®*) = 1, meaning that alternative A; coin- 
cides with A>est. On the contrary, if d”°"s*(A;) = 0, then C(A;, A>**) = 0, 
meaning that alternative A; coincides with the ideal best solution A¥°™*. 
Thus, the preference ranking of all alternatives A; € A is made according to 
the descending order of C(A;, AP**). 





3.4  BF-TOPSIS coupled with ER-MCDA to deal with imperfect Sij 


To deal with the DMA2 and imperfect information, we propose to couple (mix) 
BF-TOPSIS with ER-MCDA according to the following steps: 


e Step 1,.~=Step lag (M° construction): We use the same step 1 from ER- 
MCDA to obtain the matrix M® = [mF (-)] defined by Eq. (8) for the FoD 
O={61,...,0x,..., 0q}. 


e Step 2,,.. (M^ construction): ER-MCDA is coupled with BF-TOPSIS in this 
step. We obtain the BBA matrix M^ = [m4 (-)] related to the FoD A from the 
BBA matrix M® as follows: 


1. For each m&(-), i =1,...,M,j = 1,...,N, restricting the decision to sin- 
gletons, one chooses 6(Ai, C;) applying Eq. (2) with m = mS. This gives 
the M x N matrix S® = [6(A;,C;)] with qualitative scores 6(A;,C;). The 
corresponding quality indicator is computed by q(O(Ai, C;)) applying Eq. (5) 


> = O 
with m = mij- 
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2. A quantitative transformation of each element 0, in O is made to obtain 
the M x N matrix S = [S;;], Sij being the quantitative transformation of 
6(Aj, C;). Several transformations are possible. We are aware that the choice 
of one can impact the final results. We introduce it as a general step and 
propose to analyze the results given different transformations in forthcoming 
publications. 

3. From the score matrix S = [S;;], we use the formulas (9)-(11) to obtain the 
BBA matrix M^ = [mA (-)] for A = { A1, Ao,..., Am}. 

e Step 3„ew (ranking alternatives): We use q((i,7)) as the reliability factor to 
discount each BBA mi (+) using the Shafer discounting method [6]. For each 
Ai, we combine them with the PCR6 rule to obtain the BBA m#(-), taking 
into account the importance factor w; of each criterion C; [7]. As explained in 
points 2 and 3 of subsection 3.4, the relative closeness factors C(A;, A>***) are 
calculated, from which the preference ranking of all A; is deduced. 


4 Effectiveness of torrential check dam series 


To reduce potential damage on at-risk housing, each torrential check dam series 
stabilizes the torrent’s longitudinal profile to curtail sediment release from the 
headwaters. Their effectiveness in achieving this function depends on N = 7 
technical criteria Cj; with their importance weights w;, as shown in Figure 1. An 
expert assesses M = 4 check dam series A; according to their effectiveness given 
an imperfect evaluation of each C; and using ER-MCDA step 1. After this com- 
mon step, ER-MCDA step 2 is used to assess (DMA1) the effectiveness of each 
A; expressed by four qualitative labels (levels) in O = {high, medium, low, no} 
[1]. Then steps 2 and 3 of the method based on BF-TOPSIS3 developed in sec- 
tion 3.4 are used to rank all A; and to choose the most effective one, Aj» (DMA2). 


e Step 1,..=Step loa (M° construction): The expert evaluates each criterion 
C; for each A; through possibility distributions. N = 7 fuzzy scales are specified, 
each one gathering the q = 4 fuzzy sets 0k, k = 1,...,q. The BBA matrix 
M® = [mE (-)] obtained for O = {high, medium, low, no} is given in Table 1. 


Fig. 1. Formalization of the actual MCDM problem. 














C4 - smallest | C2-check |C3- longitudinal] C4- stability of | C5 - stability of | Cg - active C7- 
free spillway dam’s mean | implantation of | significant other check longitudinal active 
dimensions orientation check dams check dams dams erosion lateral erosion 























w7=0.1 Ww2=0.2 w3=0.1 w4=0.15 W5=0.05 W6=0.2 w7=0.2 
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Table 1. ME provided by Step liew=Step loia. 





A; Focal mS (-) 
element|| Cı C2 C3 Ca Cs Ce C7 

1 0.2963) 0.1755)0.0161)0.0000)0.0000]0.0000]0.1378 
02 0.627010.755610.9107/0.0000/0.0391|0.1748|0.8083 
Ai 03 0.0467 10.0389 10.0432 10.0009 /0.4099|0.7786|0.0239 
04 0.0000 10.0000 10.0000 10.9691 /0.5210/0.0166|0.0000 
O 0.0300 10.0300 10.0300 10.0300 /0.0300|0.0300|0.0300 
1 0.8446 10.0052 10.0310 10.9281 /0.0693|0.6434|0.0073 
02 0.125410.26770.9232/0.0419/0.3469|0.3266|0.9250 
Ag 03 0.0000 0.6050) 0.0158) 0.0000)0.2670)0.0000|0.0377 
04 0.0000 10.0921 10.0000 10.0000 /0.2868/0.0000/0.0000 
O 0.0300 10.0300 10.0300 10.0300 /0.0300|0.0300|0.0300 
0i 0.7159|0.0019)| 0.6463) 0.0000)0.0000]0.7154]0.0000 
02 0.2541 10.146410.3237 0.0451 /0.0338|0.2546|0.3769 
A3 83 0.0000 0.6655) 0.0000) 0.3786) 0.2188]0.0000]0.5578 
04 0.0000) 0.1562)0.0000)0.5463)0.7174]0.0000]0.0353 
O 0.0300 10.0300 10.0300 10.0300 /0.0300|0.0300|0.0300 
1 0.3372) 0.3950) 0.3849) 0.0000)0.0576]0.0022]0.0000 
02 0.4731)|0.5676)| 0.2460) 0.1562)/0.3390]0.7030]0.5075 
Aa 03 0.1597|0.0074|0.3391|0.7831|0.5147|0.2643)|0.4371 
04 0.0000 10.0000 10.0000 10.0307 )0.0587]0.0005]0.0254 
O 0.0300 10.0300 10.0300 10.0300 /0.0300|0.0300|0.0300 











Me 















































e DMA1 (based on Step 2,:4 described in section 3.2): given M® in Table 1, 
the column dg" in Table 2 lists the minimal value obtained for dg;(m?, m4o,}) 


defined by Eq. (3), for each A; € A. The best label 6(A;) is chosen for each 
Ai. Three check dam series A1, A2, and A4 are declared as medium, and A3 is 
declared as low. The DM coarsely has A; > A3, Ag > A3 and A4 > A3. 


Table 2. Final results for DMA1 based on ER-MCDA step 2.ia from M®. 





A;| di? |6(A;)| Final class|Ranking 
Ai |0.3769] 62 medium 1-3 
A2/0.4837| 02 medium 1-3 
A3|0.5096| 03 low 4 
A410.3911| 62 medium 1-3 


























e DMA2 (based on Step 2aew and Step 3„ew described in section 3.4): given M® 
in Table 1, for each A; and C}, one computes arg mink=1,...,q dgr(m$, m46,}) be- 
tween each m§(-) and the categorical BBA m4o,}(-), with O = {01 = high, 02 = 


new 
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medium, 03 = low, 64 = no}. The linear quantitative transformation: 6; = 4,02 = 
3,03 = 2, 04 = 1 is assumed to establish the matrix S = [S;;] in Table 3. For each 
A; and C}, the quality factor q(@(A;,C;)) is also computed in Table 3 applying 


Eq. (5) with m = me. 


Table 3. Sı; and q(6(Ai,C;)) (= qli, j)) provided by Step 2new from M®. 





Cj,wj| C1,0.1 C2, 0.2 C3,0.1 | C4,0.15 | Cs,0.05 | Ce, 0.2 C7, 0.2 
Ait [Sa q(i,1)|Si2 qli, 2) [Sis q(t, 3) [Sia ali, 4) [Sis (7,5) [Sie ali, 6) [Siz_a(4, 7) 
A, | 3 0.8747] 3 0.9226] 3 0.9754] 1 0.9921] 1 0.8332) 2 0.9287) 4 0.9404 
A2 | 4 0.9505} 2 0.8708} 3 0.9794] 4 0.9797] 3 0.8737) 4 0.8754] 3 0.9794 
A3 | 4 0.9029} 2 0.8953} 4 0.8765] 1 0.8435) 1 0.9078) 4 0.9027) 2 0.8469 
Aa | 3 0.8747} 3 0.9226] 4 0.9754] 2 0.9921] 2 0.8332) 3 0.9287) 3 0.9404 






































After the reliability discounting of BBAs from Table 1 by the factors q(6(Aj, C;)) 
from Table 3, one obtains M4 = [m4 (-)] for A = {Aj, Ao,..., Am }. After apply- 
ing BF-TOPSIS3, we obtain the relative closeness C(A;, A°**) values in Table 4. 
The ranking of all A; according to their effectiveness is consistent with the DMA1 
results: Ag > A4 > A, > A3. The most effective check dam series is Ag. 


Table 4. Final results for DMA2 based on step 3new from Table 3. 








AlE {A d" ACA, A’) Ranking 
Aı 0.5965 | 0.3061 | 0.3391 3 
A2| 0.4930 | 0.4069 | 0.4521 1 
A3| 0.6431 0.2683 0.2944 4 
Aal 0.5033 | 0.4090 | 0.4483 2 























5 Conclusion 


The ER-MCDA helps provide a coarse ranking of torrential check dam series 
according to their effectiveness, taking into account several imperfectly scored 
criteria. Given the same imperfect MCDM problem, risk managers may need a 
finer ranking. For this purpose, we suggested coupling the ER-MCDA and BF- 
TOPSIS methods. We have shown the consistency of coarse and finer ranking 
results for only one example. Further studies are needed to determine whether 
such consistency holds in general or for certain classes of examples. Moreover, 
an intermediary decision step and a quantitative transformation are needed to 
meet this goal. The sensitivity of results to their definition is under evaluation 
and will be reported in forthcoming publications. 
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